Deduplication in Yaffs

NAND flash memory has been the single biggest change to drive technology in recent years, with the storage medium showing up in data centers, laptops and in memory cards in mobile devices. It addresses the performance problems in storage. Data Deduplication is simple yet effective technology providing solution to the massive storage requirements of data. Deduplication removes redundant files/blocks of data and ensures that only unique data are stored. We embody the advantages of deduplication and solidstate disks making storage efficient, practical. We have implemented deduplication in YAFFS2, the NAND specific Flash file system on Android OS using chunk index, a compact in memory data structure for identifying new file chunks, which abates data storage limitations. The properties of solid-state devices are harnessed to reduce the complexity of implementation. We implement simple chaining and caching for further optimization. We show that the write time for duplicate data and the storage space has been reduced extensively.